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Abstract 

: 

We study the observability of the t~t + decay mode of a Higgs boson produced 
CN ' in the s-channel at a muon collider. We find that the spin correlations of the 

£^ ■ t~t + in r — > ttu t , pv T decays are discriminative between the Higgs boson 

■^J- . signal and the Standard Model background. Observation of the predicted 

distinctive distribution can confirm the spin-0 nature of the Higgs resonance. 

The relative coupling strength of the Higgs boson to b and r can also be 

experimentally determined. 

I. INTRODUCTION 

The Higgs boson is a crucial ingredient for electroweak symmetry breaking in the Stan- 
dard Model (SM) and in supersymmetric (SUSY) theories. In the minimal supersymmetric 
standard model (MSSM), the mass of the lightest Higgs boson must be less than about 135 
GeV |l|], and in a typical weakly coupled SUSY theory m h should be lighter than about 
150 GeV [Q]. On the experimental side, the non-observation of Higgs signal at the LEP-II 
experiments has established a lower bound on the SM Higgs boson mass of 106.2 GeV at 
a 95% Confidence Level (CL) [Q and future searches at LEP-II may eventually be able to 
explore a SM Higgs boson with a mass up to 110 GeV. If the Fermilab Tevatron can reach 
an integrated luminosity of 10 — 30 fb _1 , then it should be possible to observe a Higgs boson 
with 5<r signal for mh < 130 GeV and even possibly to 190 GeV with a weaker signal J3J. The 
CERN Large Hadron Collider (LHC) is believed to be able to cover up to the full range 
of theoretical interest, to about 1000 GeV ||, although it may be challenging to discover a 
Higgs boson in the "intermediate" mass region 110 GeV < rrih < 150 GeV due to the huge 
SM background to h — > bb and the requirement of excellent di-photon mass resolution for 
the h — > 77 signal. 
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Once a Higgs boson is discovered, it will be of major importance to determine its prop- 
erties to high precision. It has been pointed out that precision measurements of the Higgs 
mass, width and the primary decay rates such as h — > bb, WW* and ZZ*, can be obtained 
via the s-channel resonant production of a neutral Higgs boson at the first muon collider 
(FMC) ||. To determine the Higgs boson couplings and other properties, it is necessary to 
observe as many decay channels as possible. 

A particularly important channel is the t~t + final state 

- T-T+. (1) 

In the SM at tree level, this s-channel process proceeds in two ways, via j/Z exchange and 
Higgs boson exchange. The former involves the SM gauge couplings and presents a char- 
acteristic FB (forward-backward in the scattering angle) asymmetry and a LR (left-right 
in beam polarization) asymmetry; the latter is governed by the Higgs boson couplings to 
t~t + proportional to the fermion masses and is isotropic in phase space due to spin-0 
exchange. With the possibility for beam polarizations of a muon collider, the asymmetries 
were studied in Ref. [|7| to improve the Higgs boson signal to background ratio. The un- 
ambiguous establishment of the r~r + signal would allow a determination of the relative 
coupling strength of the Higgs boson to b and r and thus test the usual assumption of r — b 
unification in SUSY GUT theories. The angular distribution would probe the spin property 
of the Higgs resonance. 

In this paper, we propose to make additional use of spin correlations in the final state 
t~t + events. We will demonstrate the significant difference of spin correlations between 
the background events from the spin-1 7/Z exchange and the signal events from the spin-0 
Higgs exchange. The correlation is particularly strong for the two-body decay modes for 
r — > nu T , pv T . In Sec. II, we analyze the t~t + production and decay and present our results. 
In sec. Ill, we provide further discussions on the results and draw our conclusion. 

II. ANALYSIS 

The s-channel Higgs boson (spin-0) exchange populates the helicity combinations 

of left-left (LL) and right-right (RR). This results in the correlation of r _ r + polarization of 
LL and RR by angular momentum conservation. In contrast, the SM background channel 
yields r~r + polarization combination of left-right (LR) and right-left (RL). By studying 
the decay products from the correlated and polarized r*, we can effectively distinguish these 
two channels and gain information about the spin of the resonance. 

A. Production cross section for \i ~ fi + — > r~r + 

The differential cross section for — > t~t + via s-channel Higgs (h) exchange can be 
expressed as 
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FIG. 1. Normalized differential cross section for fj, fi + —* r r + . The solid curve is for the SM 
j/Z exchange and the dashed line is for a scalar h exchange. 



where 6 is the scattering angle between yT and r~, P T the percentage longitudinal polariza- 
tions of the initial fi T beams, with P = — 1 purely left-handed, P = +1 purely right-handed 
and P = unpolarized. Wh is the integrated unpolarized cross section convoluted with the 
collider energy distribution M, 



4tt B(h -> fi-fx + )B(h -> r~r H 



mi 



1/2 



(3) 



where B(h — > £ £ + ) is the Higgs decay branching fraction and Th is the total width. The 
Gaussian rms spread in the beam energy y/s is given by 



a 



V2 



(4) 



with R the energy resolution of each beam, anticipated in the range R ~ 0.05% — 0.005%. 
Note that for a very narrow Higgs boson, like that of the SM for < 140 GeV, the cross 
section in Eq. (|) is proportional to Yh/a^. 

The unpolarized cross section for the SM background can be written as 



dcosO 



-a QED [A(l + cos 2 9) + Bcos9], 



(5) 



where (Jq ED is the QED cross section for yU~/i + — > 7* — > r _ r + and the coefficients A and B 
are functions of the c. m. energy and gauge couplings M . The interference between the vector 
current and the axial- vector current leads to a forward-backward asymmetry characterized 
by 
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Jq d cos 6 (da/ d cos 6) — J^d cos 6 (da/ d cos 6) 3B 

FB ~ $\ d cos 6 (da /d cos 6) ~ 8 A ' ^ ' 

Furthermore, the chiral neutral current couplings lead to a left-right asymmetry which can 
be characterized by Alr defined as 

A _ a LR-*LR+RL ~ a RL^LR+RL / 7 \ 

LR ~ Z ~JT7r " \ > 

a LR-^LR+RL ' a RL^LR+RL 

Again with longitudinal polarizations P T for the fi T beams, the differential cross section for 
the SM background is 

4^ = ^qedA[1 - P + P- + (P + - P-)A LR ](l + cos 2 6 + | cosM^). (8) 
a cos a o o 

Here the effective F.B asymmetry factor is 

e// _ A FB + Pett A LR / q\ 



the effective polarization is 



effS±LR 



p« = t5&:< (10) 



and 



j^FB _ a LR+RL^LR ~ &LR+RL^RL q-jx 
LR+RL^LR + &LR+RL-+RL 

For the case of interest where initial and final state particles are leptons, = Aj^j. 

From the cross section formulas of Eqs. (|2|) and (^), the enhancement factor of the 
signal-to-background ratio (S/ B) due to the beam polarization effects is 

S l + P - P + (12) 



B 1 - P_P+ + (P+ - PJ)A 



LR 



The normalized differential cross section for — > t~t + at y/s = = 120 GeV is 
shown in Fig. |l]for both the SM j/Z exchange (solid curve) and a scalar h exchange (dashed 
line). We see that the SM distribution exhibits a clear forward-backward asymmetry; while 
the scalar exchange is flat, as expected. Calculation shows that at this c. m. energy, the 
SM process yields Afb ~ 0.7 while Alr ~ 0.15. Using the initial polarized beam and the 
forward-backward asymmetry to improve the precision measurement has been discussed in 



B. t decay and final state spin correlation 

As noted previously, the final state polarization configurations of t~t + from the Higgs 
signal and the SM background are very different. The r decay modes and their branching 
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r decay modes 




ev e v T 


TIV T 


pv T 


a\v T 


branching fraction Bi (%) 


17.37 


17.81 


11.08 


25.02 


18.38 



TABLE I. r decay modes and branching fractions from Ref. Q. 

fractions (Bi) are listed in Table I. The vector and axial vector resonances p and a\ subse- 
quently decay into 2n and 2>n respectively and the vector meson masses can be reconstructed 
from the final state poins. There is always a charged track to define a kinematical distribu- 
tion for the decay. In the r-rest frame, the normalized differential decay rate can be written 

as 

where 9 is the angle between the momentum direction of the charged decay product in the 
r-rest frame Jl0| and the r-momentum direction, Bi is the branching fraction listed in Table 



I, and P T = ±1 is the r helicity. For the two-body decay modes, and bi are constant and 
given by 

a 7T = b 7T = 1, (14) 

di = 1 and bi = x for i = p, a 1 . (15) 

m l T + 2mf 

For the three-body leptonic decays, the a e and b e are not constant for a given three- 
body kinematical configuration and are obtained by the integration over the energy fraction 
carried by the invisible neutrinos. One can quantify the event distribution shape by defining 
a "sensitivity" ratio parameter 

Tr = (16) 

For the two-body decay modes, the sensitivities are r n = 1, r p = 0.45 and r ai = 0.007. The 
t — » a\v T mode is consequently less useful in connection with the r polarization study. As 
to the three-body leptonic modes, although experimentally readily identifiable, the energy 
smearing from the decay makes it hard to reconstruct the r~r + final state spin correlation. 

The differential distribution for the two charged particles (i,j) in the final state from 
t~t + decays respectively can be expressed as 

dcosMcos^ ~ , {a ' + "' P - C0St>Ma ' + "'^ C0S <^ (17) 

where cos^j (cos#j) is defined in r _ (r + ) rest frame as in Eq. (|T3]) . For the Higgs signal 
channel, t~t + helicities are correlated as LL (P T - = P T + = — 1) and RR (P T - = P T + = +1). 
This yields the spin-correlated differential cross section 

d-Vh , n n \ BiBj 



dcos 9 id cos 9 j 



1 + P-P + )<7h — -r^ [ci'iO'j + bibj cos 9i cos 6j], (18) 
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FIG. 2. Double differential distribution for p~ p + —* /i —* t~t + — > p~v T p + v T . \fs = mh = 120 
GeV is assumed. Initial beam polarizations are taken to be P_ = P+ = 0.25. The Higgs pro- 
duction cross section is convoluted with Gaussian energy distribution for a resolution R = 0.05%. 



where the factor (1 + P_P + ) comes from the initial /i T beam polarization; <Jh is the un- 
polarized total cross section. We expect that the distribution reaches maximum near 



cos 9j 



cos 9i 



±1 and minimum near cos#,- 



— cos 9j 



±1. How significant the 
peaks are depends on the sensitivity parameter in Eq. fll6|) . Here we simulate the double 
differential distribution of Eq. ( IB ) for pT p + — > h — > t~t + — > p~v T p + v T and the result is 
shown in Fig. |^. Here we take y/s = = 120 GeV for illustration. The Higgs production 
cross section is convoluted with Gaussian energy distribution M for a resolution R = 0.05%. 
We see distinctive peaks in the distribution near cos9 p - = cos9 p + = ±1, as anticipated. In 
this demonstration, we have taken fi T beam polarizations to be P_ = P + = 25%, which is 
considered to be natural with little cost to beam luminosity |fnj| . 

In contrast, the SM background via 7*/Z* produces t~t + with helicity correlation of 
LR (P r - = — P T + = — 1) and RL (P T - = — P T + = +1). Furthermore, the numbers of the 
left-handed and right-handed r~ at a given scattering angle are different because of the left- 
right asymmetry, so the initial muon beam polarization affects the t~t + spin correlation 
non-trivially. Summing over the two polarization combinations in t~t + decay to particles i 
and j, we have 



da 



SM 



d cos 9 id cos 9j 



;i-p_p + K m (i + p eff A LR )x 



BjBj 



[(ajOj — bibj cos 9 { cos 9j) + A e /^(aibj cos 9j — djbi cos 9; L )]. (19) 



The effective PP-asymmetry factor is given by 
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FIG. 3. Double differential distribution for fj,~ fi + — > 7* /Z* —* t~t + — > p~v T p + v T . y/s = 120 
GeV is assumed. Initial p^ beam polarizations are taken to be P_ = -P+ = 0.25. The SM pro- 
duction cross section is convoluted with Gaussian energy distribution for a resolution R = 0.05%. 



e J J e J J AFB i p a 

A eff _ a LR+RL->LR ~ a LR+RL^RL _ ^LR + ^eff^FB (r>n ^ 

CT L R+RL^LR + °LR+RL-,RL 1 + F eff A LR 

with <7 e ^ the cross section including the percentage beam polarization P±. The final state 
spin correlation for — > 7*/Z* — > t~t + decaying into p"p + pairs is shown in Fig. |3|. The 
maximum regions near cos6 p - = —cos8 p + = ±1 are clearly visible. Most importantly, the 
peak regions in Figs. |2] and |3| occur exactly in the opposite positions from the Higgs signal. 
We also note that the spin correlation from the Higgs signal is symmetric, while that from 
the background is not. The reason is that the effective Li?-asymmetry in the background 
channel changes the relative weight of the two maxima, which becomes transparent from 
the last term in Eq. (p!9|). 



C. Results 

The total cross sections of the s-channel Higgs signal (a s ) and the SM background (a B ) 
for n~ ji + — > r~r + are listed in Table [TT] with y/s = rrih = 100 — 130 GeV. We show the 
signal results for three different beam energy resolutions R = 0.05%, 0.01% and 0.005%. 
A better beam energy resolution significantly improves the signal rate for the very narrow 
Higgs resonance with a width of order of a few MeV, while it has a negligible effect on the 
background rate. Also shown in the Table are the signal-to-background ratios (S/B) and 
the signal statistical significances (S/y/B) for an integrated luminosity of 1 fb^ 1 . We expect 
signals that are quite statistically significant. Even if we consider a luminosity of only 0.1 
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sfs = m h (GeV) 


100 


110 


120 


130 




55000 


19300 


12000 


8900 


a s (R = 0.05%) 


478 


380 


286 


189 


S/B (%) 


0.87 


2.0 


2.4 


2.1 


s/Vb (i fb- 1 ) 


2.0 


2.7 


2.6 


2.0 


a s (R = 0.01%) 


2140 


1690 


1250 


806 


b/B (To) 


3.9 


8.8 


10 


9.0 


s/Vb (i fb- 1 ) 


9.1 


12 


n 


8.5 


a s (R = 0.005%) 


3750 


2970 


2170 


1350 


S/B (%) 


6.8 


15 


18 


15 


S/VB (1 ft" 1 ) 


16 


21 


20 


14 



TABLE II. Total cross sections (in units of fb) of yT fi + — * t~t + for the s-channel Higgs signal 
for y/s = rrih = 100 — 130 GeV and the SM background. Also shown are the signal-to-background 
ratio (S/B) and the signal statistical significance (S/VB) for an integrated luminosity of 1 fb -1 . 
The Higgs channel cross sections are evaluated for three different beam resolutions (R). The 
polarization of the initial [i beams is taken to be zero. 



fb and include only the clean channels listed in Table |that count for 90% of the branching 
fraction, the R = 0.005% case still gives a significance better than 3a. 

As a further refinement in the analyses, we demand the final state r~r + to be away from 
the beam hole by 15°, or equivalently 

|cos#|<0.97. (21) 

This reduces the signal rate by about 3% and the background rate by about 5%. One could 
expect to improve the signal observability by imposing more stringent cuts on cos 9 |7J . 

We explore another approach instead to exploit the t~t + spin correlation. From Figs. |2| 
and |3|, we see that if we focus on the kinematical region cos#j = cos#j ~ ±1, we can 
substantially improve the ratio S/B. We need to preserve a sufficient signal rate by not 
taking too tight angular cuts. For illustration, we apply the acceptance cuts on the decay 
angles in r rest frame with 

cos 6*i > 0, cos 62 > 0, 
or cos#i<0, cos# 2 <0. (22) 



In Table |ITT| , we give the results for the p~u T p + u T final state from r~r + decay. Because this 
mode has the largest branching fraction of about 25%, the cross section is larger than for 
other modes. However, the sensitivity parameter in Eq. ([16]) for this mode is not maximal, 
being about 0.45. The surviving signal (background) is 53% (48%) after the acceptance cuts 
of Eq. (P^). The S/B after the cuts does not improve much. The tc~v t 7t + v t mode has the 
maximal sensitivity factor of one, but a rather small cross section due to the low branching 
fraction. The surviving signal (background) is 63% (38%) after the acceptance cuts, and 



the S/ B is appreciably improved. The results are shown in Table |V 
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FIG. 4. Integrated luminosity (in fb ) needed for observing the two-body decay channels 
r — * pv T and r — ► ixv T at 3<r (solid) and 5<r (dashed) significance. Beam energy resolution 
R = 0.005% and a 25% polarization are assumed. 



A 25% polarization of both beams only slightly improves the signals and decreases the 
backgrounds, as implied by Eq. dl2|) . Higher beam polarization could help improve S/B, 
but perhaps at a significant cost to the luminosity JTl] . 

We next estimate the luminosity needed for signal observation of a given statistical 
significance. The results are shown in Fig. |j. The integrated luminosity (L in fb" 1 ) needed 
for observing the characteristic two-body decay channels r — > pv T and r — > tiv t at 3cr (solid) 
and 5<T (dashed) significance is calculated for both signal and SM background with y/s = m^. 
Beam energy resolution R = 0.005% and a 25% jj, beam polarization are assumed. 

Based on Tables [ITJ and [TVl we estimate the statistical error on the cross section mea- 
surement. If we take the statistical error to be given by 



VS + B 1 V^s + o B 



S 



0s 



(23) 



summing over both pv T and 7rz/ T channels for R = 0.005%, a 25% beam polarization with 1 
fb -1 luminosity, we obtain 



v/i = m h (GeV) 100 110 120 130 
e (%) 27 21 23 32 



(24) 



The uncertainties on the cross section measurements determine the extent to which the 
hr~T + coupling can be measured. 
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III. DISCUSSION AND CONCLUSION 



If we only consider the txv t and pv T channels that best preserve the t~t + spin correlation, 
the effective branching fraction is only 36% and we may be limited by statistics. However, 
the distinctively different double differential distributions of the signal and the SM back- 
grounds may provide definitive information for determining the spin of the resonant Higgs 
particle. When analyzing the data sample, one may consider a sophisticated fitting to the 
superposition of the signal and background distributions. 

The characteristic angular distributions of polarized r decays are only simply manifest 
in the r rest frame. It is thus desirable to infer the r momenta in order to boost the 
final state particles (p, tt, t etc.) to the parent r rest frame. Because of the excellent 
energy calibration of a muon collider, it is a good approximation to assume each r to have 
an energy of y/s/2. However, it may be experimentally challenging to determine the r 
momentum direction. One of the possible methods is to locate the secondary vertices for 
r decays. The impact parameter for r decays is d./ r y ~ f3cr T « 87 pm. This should be 
sufficiently large to be resolved by vertex detectors. 

It is important to note that it is not necessary to fully reconstruct the r momenta for 
the clean two-body channels. This is because the polar angles (^1,^2) m the r rest frame 
can be uniquely determined by the charged particle energy [PJ. If the lab- frame energy for 
p, tt is Ei, then the relation to the polar angle is 

2zi — 1 — a 2 , , 

"■«■ = < 25 > 

where the energy fraction Zi = 2£'j/y / i, a = rrii/m T and f3 is the velocity of the decay 
product. Due to the unique linear relation between cosflj and z%, two dimensional correlation 
plots for be obtained in a similar fashion as Figs. |2] and [| 

The s-channel Higgs signal at the FMC could provide a precision measurement for the 
Higgs total width || , and thus lead to the determination of the coupling strength parameter 
tan p in SUSY theories. The observation of the h — > t~t + channel in addition to the channel 
h — > bb is very important: The relative strength of the Higgs couplings to b and to r could 
be an indicator to the underlying physics, such as the possibly large non-universal radiative 
effects in MSSM [12|| from the chargino and gluino loops, and radiatively generated Yukawa 
couplings We expect that the measurement of the coupling ratio is robust, and only 
statistically limited in the t~t + mode. If a high degree of transverse polarization of the 
beams is achievable, one could consider the possibility to determine the CP properties of 
the Higgs boson coupling PJUfl by making use of the r _ r + mode. 

In summary, we have demonstrated the feasibility of observing the resonant channel 
li rr + at a muon collider. For a narrow resonance like the SM Higgs boson, a good 
beam energy resolution is crucial for a clear signal. On the other hand, a moderate beam 
polarization would not help much for the signal identification. The integrated luminosity 
needed for a signal observation is presented in Fig. ^. Estimated statistical errors for the 
p~ p + — > h — » t~t + cross section measurement are given in Eq. (pip. We emphasized the 
importance of final state spin correlation to purify the signal of a scalar resonance and to 
confirm the nature of its spin. It is also important to carefully study the r~r + channel of 
a supersymmetric Higgs boson which would allow a determination of the relative coupling 
strength of the Higgs to b and r. 
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y/s = m h (GeV) 


100 


110 


120 


130 


P + = P- = 0, no cut 










u B 


3450 


1210 


754 


559 


Oc (R = 05%) 


29.9 


23.8 


17.8 


11.9 


SIB (%) 


0.87 


2.0 


2.4 


2.1 


a s (R= 0.01%) 


134 


106 


78.5 


52.9 


5/B (%) 


3.8 


8.8 


10 


9.4 


ct 5 (i? = 0.005%) 


235 


186 


136 


84.3 


S/B (%) 


6.8 


15 


18 


15 


P + = P_ = 0, cut p^) 












1630 


573 


357 


265 


ere fi? = 05%) 


15.7 


12.5 


9.38 


6.23 


SIB (%) 


0.96 


2.2 


2.6 


2.4 


a s (R = 0.01%) 


70.3 


55.8 


41.3 


26.6 


S/B (%) 


4.3 


9.7 


12 


10 


ct 5 (P = 0.005%) 


123 


97.6 


71.2 


44.3 


S/B (%) 


7.6 


17 


20 


17 


P+ = P- = 0.25, cut (||) 












1530 


537 


335 


249 


ct 5 (P = 0.05%) 


16.7 


13.3 


9.97 


6.62 


S/B (%) 


1.1 


2.5 


3.0 


2.7 


<r s (R = 0.01%) 


74.7 


59.3 


43.9 


28.2 


5/5 (%) 


4.9 


11 


13 


11 


a s (P = 0.005%) 


131 


104 


75.7 


47.1 


S/B (%) 


8.6 


19 


23 


19 



TABLE III. Total cross sections (in units of fb) of /U~ / u + — > t~t + — ► p~i> T p + 9 T for the s-channel 
Higgs signal (S) at y/s = rrih = 100 — 130 GeV and the SM background (B). The polarization of 
the initial \i beams is taken to be and 25% for comparison. The Higgs channel cross sections are 
evaluated for three different beam resolutions (P). The signal-to-background ratios (S/B) are also 
given. 
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V a — " h h * j 


100 


1 1 

ill/ 


120 


1 30 


P, = P = no rut 












677 


237 


1 48 


1 1 

11U 


<r^ ( R — Q 05%) 

L/C 111 L/ . UU / (J 1 


5 86 


4 67 


3 50 


2.32 


S7.B C%) 

*_/ / J-f \/V J 


0.87 


2.0 


2.4 


2.1 


a s (R = 0.01%) 


26.2 


20.8 


15.4 


9.90 


S/B (%) 


3.9 


8.8 


10 


9.0 


a s (R = 0.005%) 


46.0 


36.4 


26.6 


16.5 


S/B (%) 


6.8 


19 


18 


15 


P_i_ = P =0 cut (22) 












254 


88.9 


55.5 


41.1 


<T„ (R = 05%") 

L/C V J. L i_/ . v7tJ / vj ( 


3.66 


2.92 


2.19 


1.45 


S7.B C%) 


1.4 


3.3 


3.9 


3.5 


a s (R = 0.01%) 


16.4 


13.0 


9.62 


6.19 


S/B (%) 


6.5 


15 


17 


15 


ct 5 (P = 0.005%) 


28.8 


22.8 


16.6 


10.3 


S/B (%) 


11 


26 


30 


25 


P+ = P_ = 0.25, cut (HI) 












238 


83.4 


52.0 


38.6 


ct 5 (i? = 0.05%) 


3.89 


3.10 


2.32 


1.54 


S/B (%) 


1.6 


3.7 


4.5 


4.0 


<r s (P = 0.01%) 


17.4 


13.8 


10.2 


6.58 


S/B (%) 


7.3 


17 


20 


17 


<r s (R = 0.005%) 


30.6 


24.2 


17.7 


11.0 


S/B (%) 


13 


29 


34 


29 



TABLE IV. Total cross sections (in units of fb) of — > t~t + — > ir~ v T ir + v T for the 
s-channel Higgs signal at yfs = rrih = 100 — 130 GeV and the SM background. The polariza- 
tion of the initial fi beams is taken to be and 25% for comparison. The Higgs channel cross 
sections are evaluated for three different beam resolutions (R). The signal-to-background ratios 
(S/B) are also given. 
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